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Chapter 1. Introduction 






1.1 Problem Description 

This diesis deals with the time-optimal control of a tendon arm system. The tendon arm system 
consists of a rigid link attached to a base plate through a three degree-of- freedom joint thus affording the 
arm rotational freedom in three axes Movement of the arm is made possible by four tendons: one end 
of each tendon is attached to the top of the arm and the other end is wound on a motor shaft located 
under die base plate. The design of the tendon attachments is such that through die interaction of die 
four motors and tendons, and by controlling die current input (or torque output} of die motors, control of 
the movement of the arm in diree axes is possible. Section 2.1 contains a more detailed description of the 
tendon arm system, and figure 2-1 shows a schematic diagram of it. The tendon arm system is designed by 
John Hollerbach and Danny Hillis of the Ml.T. Artificial Intelligence Laboratory. 

We are interested in designing a controller to move die arm from an initial position to any specified 
final position. Time-optimal control is chosen because 

1. it achieves the desired motion in minimum Ume — this is desirable because the faster it can move, the 

more motion tasks per unit time could be completed this way, and 

2. it requires few words of computer memory to represent the optimal solution — traditionally, time- 

optimal solution is associated with bang-bang control, hence the optimal solution is completely 

specified by the switching times. 
These are the motivations for choosing time-optimal control, namely, it yields a rapid-moving system 
which is implementable. 

The second point mentioned in the last paragraph is only valid if the problem is nonsingular. In 
the presence of singularity, the time-optimal solution need not be bang-bang. Our problem is, in fact, 
singular, but die form of the singular arcs is such that die control signals can be approximated very closely 
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by straight line segments, hence the storage requirements for such a control is quite low also (about 5 
integer words per trajectory). 

Since our system equations are highly nonlinear and complicated, it is not possible to express the 
optimal solution in feedback form. Thus, in addition to this open-loop control, some sort of closed-loop 
control law is required to correct for any disturbances. The overall control scheme will consist of two 
phases : an initial phase during which open-loop time-optimal control is app'ied, and a second phase 
which is feedback regulation at the final position. 

Although time-optimal control has been applied to manipulators (Kahn[l]), it does not shed much 
light on our problem because die tendon arm is different from conventional manipulator design. The only 
reference that is available on tendon arm dynamics is Riemenschneider et al [2] but the paper deals with a 
one degree-of- freedom arm which is much simpler than the three degree-of- freedom arm studied herein. 

1.2 Thesis Outline 

This thesis is organized into seven Chapters: 

Chapter 1 provides an introduction to the problem under study. 

Chapter 2 describes the physical tendon arm system and develops a mathematical model describing the. 
system. A simplified reduced-order model is also obtained, and the responses of the two are com- 
pared. 

Chapter 3 first states the time-optimal control problem and presents necessary conditions for the optimal 
solution from Pontryagin's Minimum Principle. These are then applied to the reduced-order model 
of the tendon arm system. 

Chapter 4 presents the conjugate gradient method and describes an iterative procedure for solving our 
time-optimal problem. Approximation for the time-optimal solution is also proposed. 

Chapter 5 motivates die need for a closed-loop feedback control law at the final position, and presents the 
linear regulator approach for designing die feedback law. 
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Chapter 6 describes the implementation of the overall control scheme. 

Chapter 7 is a summary of the results of the thesis and describes areas of further work. 
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Chapter 2. Modeling of the Tendon Arm System 

In order to study and develop a :ontro! strategy for the tendon ami system, we must have a mathe- 
matical model of it. In this Chapter, the physical system is first described, equations describing the system 
dynamics are then developed, and a reduced-order model is obtained by ignoring the third degree-of- 
freedom of the arm. 

2.1 A Description of the Tendon Arm System 

The schematic diagram of the tendon arm system is shown in figure 2-1. It is a cylindrical rod, known 
as the arm, attached at one end to a oasc plate via a three degree-of-freedom "joint". Figure 2-2 shows 
the "joint" in greater detail. The outer rectangular block, together with the inner member, can be rotated 
about the Y — Y axis. The inner member can be independently rotated about the X — X axis. The 
cylindrical part of the inner member can be rotated about the Z — Z axis, i.e. the longitudinal axis of the 
cylinder. Potentiometers are mounted as shown in the diagram to measure the three angles of rotation. 
This construction of the "joint" lends itself to a very natural way of defining the position of the arm 
in terms of the three angles 0, </>, and tp, which are measured directly by the potentiometers, as shown 
in figure 2-3. This coordinate system will be used throughout this thesis to describe the arm. Another 
coordinate system, described by the angles a, /?, and t/> 9 is sometimes used. This is shown in figure 2-4. 

At the Upper half of the cylindrical rod, there are points of "insertion" (attachment) for four tendons, 
two at one height, and the other two at another. Each tendon is wrapped around the arm through a certain 
angle before it breaks off from the surface of the arm (see figure 2-5). The other end of the tendon passes 
through a pulley on the base plate and is wrapped round a threaded cylinder mounted on the shaft of a 
motor under the base plate. As the motor rotates, the tendon will be wrapped or unwrapped from the 
motor shaft thereby causing a shortening or lengthening of the tendon between the motor and the arm. 
Through the interaction of the four motors and tendons, the arm can be moved from one position to 
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Figure 2-1. Schematic diagram of the tendon arm system 



another. 



2.2 Equations of Motion 



2.2.1 Coordinate Systems and Coordinate Transformation 

We choose as our fixed coordinate system one that has its origin at the "joint" with the rr-axis along 



potentiometer for 
Measuring <f> 



X 




potentiometer for 
■measuring 



Figure 2-2. A more detailed diagram of the three degree-of-freedom "joint" 



F 3 , P 4 and the yam along P 2( -Pi- Pu P%, ft, and P 4 arc the points on the base plate through which the 
tendons pass (refer to figure 2-5). 

In computing the dynamics of the arm, we refer all quantities to a moving coordinate system which 
is fixed to the arm and with the three axes coinciding with those of the fixed coordinate system when 
^ <f> == tp . == Q. These three axes are the principal axes of the arm. 
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Figure 2-3. Angles defining the position of the Fi 8 ure 2 ' 4 - Another set of angles that defines 
arm the position of the arm 



If P denotes the coordinates of a point in the fixed coordinate system, to refer it to the moving 
coordinate system, we need to perform the following transformations: 

1. a rotation through an angle <f> about the y-axis, and 

2. a rotation through an angle about the new z-axis, and 

3. a rotation through an angle tf> about the new 2-axis. 

i.e. 



/" = W)SrWW)P 



(2.1) 



/"■> 



where P f denotes the coordinates of the point referred to the moving (primed) coordinate system, and 




Figure 2-5. Schematic diagram of the arm showing (lie tendon wrapping geometry. 
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(2.2) 



or 



p' = w(o,<f>,ii>)p 



(2.3) 



f**^ 



/ 0m s>, 



wh^re 



W(M,10 = 



cos <j> cos ^ + sin0sin<£sint/> cos 5 sin t/? — sin cos ip -f sin0cos^sin</> 
— cos <f> simp + sin ^ sin cost/? cos cos^ sin <£ sin </> + sin cos cos \p 
cos sin — sin0 cos 9 cos <f> 



222 Some Geometric Calculations 

Referring to figure 2-6 which shows some parameters of the arm, 



Pi = 



P 2 = 



P 3 = 



P 4 = 



Using equation (2.3), 



pf — _p/ __ 



a cos sin 

a cos pos i/> 

— asin0 



P f — — P' — 
r 3 — r 4 — 



— s cos cos ip — s sin sin <0 sin ^ 

5 cos <f>simp — 5 sin sin <f> cos ip 

— s cos sin <£ 



(2.4) 



(2.5) 



(2.6) 



From now onwards, we will refer all quantities to the moving coordinate system. 

Let Qi be the point at which tendon % is attached to the arm, and R{ be the point at which tendon i leaves 
the surface of the arm. Then in order to calculate the directions in which the tendons pull on the arm, we 
need the coordinates of the /2 t -*s. 
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Figure 2-6. Schematic diagram showing some parameters of the am 



Coordinates of R{ andRi 



Let Oi, yu #i) denote the coordinates of R\ with respect to the primed coordinate system. 



From figure 2-7(a) and equation (2.6), 
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Figure 2-7. (a) Schematic of the arm looking down the z'-axis showing only tendon 1. (b) 
Unwrapping tendon 1 onto a plane. 



uj = tan l 



(a cos sin tp\ . 
acosOcostp/ 



X==cos -.(_^) 

\acos0/ 



where p is the radius of the cylindrical arm. 



(2.7) 
(2.8) 



X{ = +psin(?r — X — ■ uj) = psin(u; + M 
y x = — /?cos(7r — ■ X — a;) = pcos(a; + X) 



(2.9) 
(2.10) 
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Referring to figure 2-7(b), 
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implies 



RiNi NiPi 

z\ = —a sin -\- 



b-\- asinO 



1 + (t — w — X)/tanX 



Li = R[P[ 
h = Q\Pi 



[z x + asin0) 2 -f p 2 tan 2 X 



i 



(6 + asinfl) 2 + p 2 (-^ — w — X + tan >) 2 



(2.11) 
(2.12) 
(2.13) 



Similarly, tine coordinates of H 2 arc given by, 



£2 — — psin(w-f X) 
y 2 = — pcos(w + X) 

#2 — asin0 -{- 



6 — a sin 



U. = H 2 P 2 = 
fc = Q2P2 = 



l + (^-^-X)/tanX 
(22 — dsin0) 2 + /? 2 tan 2 X 



§ 



(6 - a sin 0) 2 + p 2 (^ - w - X + tan X) 2 



li 



(2.14) 
(2.15) 

(2.16) 

(2.17) 
(2.18) 



Coordinates ofRz andR\ 

Let 0r 3 , J/3, £3) be the coordinates of# 3 in the primed coordinates. 
From figure 2-8(a) and equation(2.6) t 



u) f = tan 



= tan" 



—j 



f — cos <j> sin ip -f sin fl sin <j> cos tA 
\ ^ cos <f> cos i/> + sin & sift (psinip J 



'(t 



tan t/> -f- tan <f> sin 



-f tan t/? tan sin 



sinA 
in ) 



(2.19) 



Define 



tan^ === tah<£sin0 



(150) 



J#* I, V 
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Figure 2-8. (a) Schematic of the arm looking down the z'-axis showing only tendon 3. (b) 
Unwrapping tendon 3 onto a plane. 



Then from equations (2,19) and (2.20), 



u/ = \i — ip 

A' = cos- 1 ( — £-= r— r 

\^s(cos 2 <f> + sin sin 0)* 

z 3 = — p cos(u/ + X 7 ) 
y 3 = — psin(a/ + X') 



) 



(2.21) 

(2.22) 

(2.23) 
(2.24) 



Referring to figure 2-8(b), 
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implies 



M 3 R 3 = M 3 Q 3 
R3N3 N3P3 

23 = — s sin 4> cos 6 -\- 
h = QiP-i = 



t + s sin <j> cos 5 



l + (^_ w '_V)/tanX / 
(23 -f s sin <£ cos0) 2 + p 2 tan 2 V 

(t + •■« sin </> cos0) 2 + ? 2 (^ - u/ - X' + tan X') 2 



li 



Similarly, for #4, 



(2.25) 
(2.26) 
(2.27) 



£ 4 = p cos(u/ -f- X') 
y 4 = psin(u/ + X') 

2 4 = ssin</>cos# + 



t — ssin^cosfl 



l + (2j: — w' — X')/ tan X' 



L4 = R4P4 — 
i 4 = Q 4 P 4 = 



2\/ 



(24 — s sin <£ cos 0f + /r tan 2 X 



i 



(t - ssin<?!>cos0) 2 + P 2 (^ - «/ - X ; + tanV) 2 



£ 



(2.28) 
(2.29) 

(2.30) 
(2.31) 
(2.32) 



Coordinates of the center of gravity 

Let G be the center of gravity of the arm (see figure 2-6), and let GD be the unit vector along the 
direction of the gravitation field which will be assumed to be vertically down. 
Expressed in the primed coordinate system, 



G = 



GD = 



sin <f> cos xp — sin cos <f> sin xp 

— sin 4> sin xp — sin cos cos xp 

— cos cos <p 



(2.33) 



(2.34) 



2.2.3 Resultant Torque exerted by the four Tendons about the point of rotation O 
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Let Ff, i = 1, . . ., 4, be the tension in tendon i, the direction of Ft will be in the direction ofRiPi. 
Resultant torque acting on the arm about 

= ORi X Fi + OR 2 X F 2 + OR 3 X F 3 + OR 4 X F 4 + OG X mg 
Fl -ORi X RiPi + t^iOR 2 X /? 2 >2 + t^tOH 3 X iJ 3 >3 



|i?iPi| l * ' ' \R2P 2 \ ' I^F 3 

+ 75^7°^ x *4 p 4 + rngOG X GD 
tTi+jTa + fcTa ( 2 -35) 



where 






Ti = — [—pa sin cos(u; + X) — z { a cos cos ip] + y^ [— /** sin cos(u; + X) + ^a cos 9 cos i/>] 
Li Lf2 

F 

H — - [ps sin cos sin(c</ + V) — ^3«(cos <f> sin ip — sin sin <£ cos t£)J 

+ -=4 [ps sin <£ cos sin(u/ + X') + 24s(cos <f> sin \j) — sin sin <£ cos ^)] 

L4 

+ mpd(sin <j> sin -f cos <jf> sin cos rp) (2. 36) 

T 2 = — [pa sin sin(u; -f X) -f z A a cos sin t/>] -f y^ [pa sin sin(u; + X) — z 2 a cos I? sin tp] 

+ 7^[— ps sin cos0 cos(t*/ + X') — 2r 3 s(cos<£ cos ip + sin <f> sin sin t/>)] 

H [— P s s i n ^ cos # cos(u/ + X') + ^s(cos <j> cos + **^ s * n s * n V0] 

L4 

+ raisin ^ cos t/> — cos ^> sin sin ip) (2.37) 

r = ( Q + *2 Y^ C os sin X + f ? + ^Vfsin * sin * C0S ( X ' + ^0 ~ cos <£ sin(X' + //)] (2.38) 
VLi L 2 J \L 3 L 4 J 

Note: The expressions in equations (2.36H2.38) are derived based on the geometry of the arm as 

described in section 2.2.2, which assumes that all the tendons are wrapped properly on the arm. In the 

course of moving from one position to another, one pair of the tendons might be completely unwrapped, 

hence the expressions developed above will not be valid. 

Referring to the notations used in section 2.2.2: 

if u) + X > 37r/4, then tendons 1 and 2 have completely unwrapped, and 

if u/ + X' > 37r/4, then tendons 3 and 4 have completely unwrapped. 
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Appendix A develops the corresponding expressions for equations (2.36)-(2.38) in the event of either pair 
of tendons is unwrapped. These expressions are only approximations as the tendon insertion is not ideal. 



2.2.4 Arm and Motor Dynamics 

Eulcr's dynamical equations for the rotation of a rigid body about a point O are given by, 



J\ 



dt 



(j 2 - j 3 )n 2 n 3 *■= n 



j^-{h-m^x = n 



dt 

dn 3 

1 dt 



(2.39) 



(/i - J 2 )QiQ2 = T 3 



where the subscripts 1, 2, 3 refer to the three principal axes of the rigid body, fit, Ji are the angular 
velocity and the moment of inertia, respectively, of die arm along the i-axis, and TV is the external 
applied torque on the body. 
By making the identification of the V-, y'; z! -axes of the arm primed coordinate system with the 

1-, 2-, 3-axes of the above, we can apply equation (2.39) to the tendon arm system, with the simplifying 

assumption that 

h = h = J. (2-40) 

* 

This assumption is valid because the contribution of the moment of inertia of the lower rectangular block 
about point 0, which is asymmetrical about the -z'-axis, is negligible compared to that of the cylindrical 
rod, which is symmetrical. 
Expressing die fit's in terms of the diree angles 0, <j> and V>, we obtain, 



fi 



fi] 

fi 2 



'cos V> + 4 cos s i n ^ 

— 'sin V> + $ cos cos V> 

—4 s i n + ^ 



(2.41) 



T\, T2, Tj arc given by equations (2.36H2.38). The tensions F x , F 2 , F 3 , F 4 in the tendons are related 



I^p*^ 
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to the input currents to the motors, I h 7 2 , h, h, through the motor dynamics 



J m % + B m -)i + F l r = KI i i = 1, . . . , 4 



(2.42) 



where 

^ is the angular velocity of die motor shaft, 

J m is the moment of inertia of the motor shaft, 

B m is the velocity dependent friction coefficient, 

r is the radius of the cylinder mounted on the motor shaft, and 

K is the torque constant of the motor. 
Because of the constraint that the tendons must be taut at all time, and the assumption that the 
tendons are inelastic, the angular rotation of each motor is related to that of the arm. 
Specifically, 

m = k-k{0A^) ( 2 - 43 ) 



where k{0, <j> } tp) is the length of tendon i (from point Q % to point P { ) when the arm is at the position 
defined by 0, <£, t/>, and k = l { {0 t 0, 0), which implies that n = when = <f> = tp = O. 
By differentiating equation (2.43) with respect to time once, we obtain 



Hi = 



66 ^d^^d^ t 



By differentiating once more, 
r% = - 






. 2^-06 + 2^-StP + 2^-# 

^ dOty &l&l> d ^ de 



(2.44) 



(2.45) 



By substituting equations (2.44H2.45) into equation (2.42), we can obtain expressions for the F t 's in 
terms of the 1^ and the three angles 0, 0, and tp. By substituting these into equations (2.36H2.39), a set 
of differential equations describing the dynamics of the tendon arm system is obtained. 
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By defining, 

x = [0 (j, V 4 4) T ( 2 - 46 ) 

u = [/i h h h] T ( 2 - 47 ) 

and rearranging terms, we obtain the equations of motion of the system in the form, 

iM=A(*(0) +#>(*(<)>(<) ( 248 ) 

where 

F {x) is a 6-vector, and 

Bq(x) is a 6 X 4 matrix. 
The full detail of equation (2.48) is given in Appendix B. 

2.3 Reduced-Order Model 

The equations of motion obtained in the previous section is too complicated to be useful in the 
design of a controller. Much of the complications arises from the geometry of the tendon arm system. 

A simplified fourth order model is obtained by ignoring the tendon wrapping about the arm, thereby 

reducing the three degree-of- freedom arm to a two degree-of- freedom one. This is achieved by equating p 

to zero (recall that p is the radius of the cylindrical arm). 

i.e., 

p = (249) 

This, in effect, is to ignore the twisting movement, </>, of the arm. 
Equations (2.39) become: 

/(0 + 2 sin0cos0) = f^ ( 2 - 5 °) 

J((j> cose — 20cf sin 6)^=1 y — j- jst cos <f> + mgd sin <£ (2.51) 



/""""V 



where 
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h = 
h = 



[a 2 -\-b 2 + 2absm9}l 
[a 2 + 6 2 -2a6sin0]i 
[s 2 + i 2 + 2s£sin<£cos<?]* 
[s 2 + t 2 — 2sts\n<l>cos0)l 



(2.52) 



From equations (2.42)-(2.45), 



Ft 



Jm.(c 



K *+'-?\p+%>+* 



tfUrt L ^i^ + 2 



d 2 l 



&)+¥&+%$ **> 



For t = 1, 2, since k is a function of 8 only, 



r 



K7* + 



T\d0 9+ W 9 ) 



,B m dli, 

+ —To e 



(2.54) 



Substituting equations (2.53H2.54) into (2.50H2.51), and rearranging terms, 
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J 



ab cos 



+ Jt 



\h <L9 



•■st sin</>sin0 . 
^ Y ab cos 



l 2 d0 
L«3 



)stsin<^sin0 . 
~r ; — ^ ""! 



ab cos 



/_!«3 , i0U\ 



r fl^ + A^M 



-*<!-£)- 



*3 <9<£ * 4 

sf sin sin 
a6 cos 



-(H) 



+ mg 



rir 2 sin0cos<ft 
a6cos0 



, ,-st sin (j> sin 

+ 9 = —° 



ab cos 



/let _ 1«A 



+ 0B„: 



V /i d0 ~*~ l 2 d0j 



+ 



s£sin<£sin0j 
ab cos 5 

1 2 l 4 



\i 3 do use J] 



■ -st sin <(> sin 9 T I i cri 3 

+ 2H ab cos "\/ 3 cW f 4 <9ftty 



+ <£ 



s£sin</>sin0 
a6 cos 



J, 



Ad 2 fe 1^4^ 
" l 3 d0d<p l 4 d9d(j>) 

10% _ \d%\ 
kdtf l 4 0<t> 2 ) 



J 



r 2 sin0 
ab 



+ 



, \( 1 d\ , 1 <*> "\ st sin sin ( 1 <9% _ 1 0%\ 
9 Jm [^ _ /7 ^ + l 2 d0 2 ) + ab cos \J 3 <^ 2 *4 M 2 ) 



'4> 



J 



r 2 cos0 (idh_ 

st cos <j> n \l 3 d4> 




+ 0J r , 



1&3 

h00 



Idh 
l 4 d0 



(2.55) 



. f 1<9% • 1^4 \1, , V (_ 1_0\ ,1^ 



+ 20<£/ 



+ 0V T 



st cos <fi 

d% 



\ h 



<10%\ 
l 3 M 2 ^ l400 2 ) 



(2.56) 



By defining, 



J^^H, 
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and 



L20 ■ 
L\eo : 
L>2ee 

L24> 

L2<p<p 
L264> 



e = 



Idh 


Idh 


hde 


hdO 


1<*3 


\dl 4 


hd6 


kae 


ld% 


id% 


hde 7 


l 2 d0 2 


ld% 


ld 2 l 4 


hee 2 


l 4 d0 2 


ldl 3 


\a 4 


hd<$> 


l 4 d(f> 


ld% 


ld\ 


hd<P 2 


i 4 d<t> 2 


ld\ 


1 &u 


hd6d<t> 


Ud0d4> 


st sin <j> 


sin 



ab cos 9 



(2.57) 



N = 



Jr 2 /ab cos 9 -}- J m Lie — Jm^2e —J m eL24> 

JmL-ie Jr 2 cos 0/st cos <f> + J-ml>24> 



(2.58) 



Equations (2.55)-(2.56) can be written as: 



f"\. 



N~ 



-Kr/h Kr/h eKr/l 3 -eKr/k 
— Kr/h Kr/l 4 



'/1 

h 
h 



+ N- 






eB m L24> 

—B r nL2<j> 



4+n- x 



—B m L,2$ 



Jr 2 sin 0/s< cos <^> — J m L20<p 
eJ m L24,<i> — Jr 2 sin 6/ab 

— Jm^2(j><i> 



20(f) 

<fi 2 + N~ l 
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Define 



x =[9 <f> 9 4? 



the reduced-order model can be written as: 



x(t) = F{x(t)) + B{x(t))u 



(2.60) 



where 



F(x(t)) = 


x 4 {t) 

M*(0) 
f 4 (x(t)\ 






B{x{tj) = 


q 

b 3 (x i (t), 352(0) 




b 4 (xi(t), 


*2{t)\ 



a 4-vector 



a 4 X 4 matrix 



(2.61) 



(2.82) 



Note: It can be easily shown from equation (2.58) and several simple substitutions that the determinant 
of N is always greater than zero for all 0, <f> between (but not including) — tt/2 and +tt/2. Hence N~ l 
always exists. 



2.4 Comparing the Responses of the Full and Reduced-order Models 

To investigate the effect of representing a sixth-order system by a fourth-order model, a step of mag- 
nitude four is applied to both I 2 and I 4 of the full (sixth) and reduced (fourth) order models developed in 
sections 2.2 and 2.3 respectively. 

The responses of the two models are shown in figure 2-9 and tabulated in Table 2-L (The values of 
the parameters used is given in Appendix G). 



/""•"•v 




Figure 2-9. Response of the full and reduced-order model due to a step input on h and U. 



24 



It can be seen that the difference between the two is small except for the fact (hat the reduced order 
system cannot model the angle */>. 
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Chapter 3. The Time-Optimal Control Problem 

As mentioned in Chapter 1, we would like to devise a control scheme to bring the arm from its initial 
position to any specified final position as fast as possible, i.e., given any desired position-*/, we would like 
to find the control u{t) which drives x{t) — x f to zero in minimum time, where x{t) is the actual position 
ofthearmattimef. 

In this Chapter, we will first formally state the time-optimal control problem as applicable in our 
case, and Pontryagin's Minimum Principle will then be used to derive necessary conditions for the time- 
optimal solution. We will then examine the time-optimal control of the tendon arm system using the 
reduced-order model. 

3.1 Problem Statement 

G i ven the dynamical system w ith state x(t). and control u{t ), 

m=F(x(fft + B{x(ti)u(t) (3-1) 

where 

x(t) is a 4-dimensional vector ^ 

■ f 
u[i) is a 4-dimensional vector 

Mztij) is a 4-veetor-valued function 

B(x{t)) is a (4 X 4)-matrix-valued function 
Find an admissible control u{t J which takes the system from the initial state xq to the final state x f in 
minimum time, i.e. find u(-) to minimize the following cost function: 






dt (32) 

where an admissible control u{) is defined to be one such that every component satisfies the following 
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magnitude constraint, 

U m in < U{[t) < U m ax t = 1, . . ., 4 (3.3) 

or written more compactly 

u{t)en for all tG [to, t f ] (3.4) 

tf in equation (3.2) is free, and is part of the optimal solution. 

In addition, F(x(t)) and B(x(t)) are assumed to posssess the follosing properties: 

1. fi(x) and bij(x) are continuous in x, and 

2. dfi(x)/dxu dbij{x)/dxk arc continuous in x, 

where / z (x), 6y(x), % are components of F(z), -B(x), and a: respectively. 

34 Application of the Minimum Principle 

Pontryagin's Minimum Principle (Athans & Falb[3]) furnishes us with necessary conditions which 
the time-optimal control u*(t) must satisfy. Any control u e (t) that satisfies all the necessary conditions 
is known as an extremal condition, and is a candidate for the optimal control. If a time-optimal control 
exists, and if there are more than one extremal control, then the one with the smallest cost given by 
equation (3.2) is optimal. 
In order to apply the Minimum Principle, we will define the Hamiltonian: 

H(x(t), p{t), u(t)) = 1 + p T (t)[F(x(t)) + B{x(t))u(t)] (3.5) 

where p(t) is a 4-dimensional costate vector. 

Let u(t) be an admissible control which transfers the system from xq to £/, and let x*(t) be the 
corresponding trajectory. In order for u(t) to be optimal, it is necessary that there exist a function p*(t) 
such that: 
(a) p*(f ) and x*{t) are a solution of the canonical system: 



'I 
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i*(0 = ^(^(i)/P*(0,«*W) ; ( 3 -'*> 

p\t)^-f-(Ai],At),u(t)) (3.7) 



satisfying the boundary conditions 



(3.8) 



(b) For -all* € '{to, t f ], 

H{x(t), p*[t), u(t)) < H(x*(t), p*(t), u) for all u G Q (3.9) 

(c) ForalUSM/], 

#(**(«),?*(<).«*(*))-<> ( 31 °) 

This is a consequence of free terminal time and time in variance of the system. 
Athans & Falb[3] presents a heuristic proof of the Minimum Principle, whereas a formal proof can be 
found in Pontryagin e< o/[4]. | 

3.3 Bang-Bang Control 

Substituting equation (3.5) into (3.9), necessary condition (b) reduces to 

p* T (t)B(x*(t))u(i)<p* T (t)B(x*(t))u foralltxGn (3.11) 

or written in component form, 

E«;wf e^(o)p:w) < E«/E^(oK(o) (312) 



i 
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for all Uj satisfying equation (3.3). 
If we define 

4 

?;w = sx^wkw j = i ^ (3.i3) 

1=1 
Equation (3.12) then becomes § 

7=1 J=l 

The control u*(t) which satisfies the above inequality and subject to the constraint of equation (3.3) is 

given by 

u*{t) = u max if q*{t) < 

u]{t) = u min if #0 > j = 1, . . ., 4 (3.15) 

u*(£) indeterminate if g*(£) = 

We see that u(t) is well-defined by equation (3.15) if there is only a countable set of times Uj £ [to, t/} 
such that 

Under this condition, every component u*[t) of the optimal control u{t) is a piecewise constant function 
of time, u*(t) is then known as a bang-bang control, and we say that the problem is Normal. 

If, on the other hand, there is one (or more) subinterval [t m , t n ] within [to, tj) such that 

q*(t) = for some j and all t £ [t m , t n ] 

then u*(t) is not defined by equation (3.15) for t £ [t m , t n ], and we say that we have a singular time- 
optimal problem; the time interval [t m , i n ]\s called the singularity interval. 

Hence we see that if the problem is normal, the time-optimal control is bang-bang. For linear 
time-invariant system, we can derive necessary and sufficient conditions for the time-optimal problem to 
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be normal (sec e.g. Athans & Falb[3]) or singular, but for general nonlinear systems, there is no such 
conditions, hence it is very difficult to rule out the existence of singularity intervals before solving the 
problem. 

3.4 Time-Optimal Control of the Tendon Arm System 

For the tendon arm system, die equations corresponding to equation (3.1) are given by equations 
(2.60M2.62) which describes the reduced-order model. 

Since the tendons can only pull but not push on the arm, there is a non-negativity constraint on the 
control, and equation (3.3) will now be replaced by 



< Ui{t) < u v 



» = !,..., 4 



(3.16) 



The expression for B(x{t)) can be obtained from equations (2.62) and (2.59): 
If we represent N~ l in equation (2.59) by 

Tin ^12 

./l21 ^22. 



N- 1 ^ 



Then 



'b 3 (x(i)Y 




&31 &32 


b 4 {x(t)) 




64 i 642 




'h{ 1 h\2 






Ml h 2 2. 



j 



= K> 



642 64 

\-Kr/h Kr/k eKr/h -eKr/k 

[ -Kr/h Krfh 

■hn/h hn/h —{hn — ^n)lh (^12 — eh n )/k 

h<2i/h h 2 i/h —(^22 — di2i)lh (^22 — &a\)lh 



and from equation (2.62), 



(3.17) 

f 



(3.18) 



j %3 



fort =» 1,2, j = 1, ...,4 



(3.19) 



j^^S 
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Substituting equations (3.18) and (3.19) into (3.13), we obtain the following expressions for q*(t): 

hiiP* 3 {t)-\-h 2 ip* 4 (t) 



q\{t) = -Kr 
q* 2 (t) = Kr 



^llP^O+^lP^O 



*t*\ v ^ ,2 — e/l n)P 3 ( < ) + (^22 — eh 2l )p* 4 [t) 

w) = — hr : -, 

'3 

*u\ i/ (hn — eh u )pl{t) + {h22 - eh2i)p* A (t) 
q 4 (t) = Kr 

The q*j{ty% will be used in equation (3.15) to determine the value of u*(t). Since the sign and not the 
magnitude of q*(t ) is important, and since K, r, l it i — 1, . . ., 4 are all positive, we will define a new set of 
qj(t) that can also be used in equation (3.15): 



(3.21) 



9i(0 = ~{hi\pl{t) + h 2l p\{t)) 
~/^- ■ ql{t) = h n p* 3 {t) + h 2l p 4 {t) 

q 3 [t) = —({h 12 — eh n )p* 3 {t) + {h 22 — eh 2l )p* 4 {t)) 
q* 4 [t) = {h V2 — eh u )p* 3 {t) + (h 22 — ehn)p 4 (t) 

and the optimal control u*(t) is given by 

U*{t) — U max ifg*(<) < 

u*(0 = if §*-(*) > j = l,...,4 (3.22) 

u*(t) indeterminate if qj{t) = 

where qj(t) is given by equation (3.21). | 

I i 

'! Note that in equations (3.21), m 

9^(0 = — 92(0 
9 3 (0 = —94(0 

If we define new variables q\ 2 [t), q*a{t) given by 



^-N 



?ia(0 = «i(0 = ~i h i 1P3C) + A21P4W) 

934(0 = 9j(0 = ~{{h\2 — e/in)P3(0 + (^22 — eh 2l )p* 4 (t)) 



(3.23) 
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Then equations (3.22) can be rewritten as 

if<7*. 2 (0<0, Uj(f) ^ u ma2 , U2(t) = 

if 9*12(0 >'«» «i(0-°. U 2 (f.) = lW ( 3 - 24 ) 

if g * 2 (t) = 0, «i(0. «2(0 indeterminate 

if 934(0 <°. «3(0 — u mta, ^(O — O 

ifg 34 (0>0. « 3 (0-0, u 4 (0 = «m,.x (3.25) 

if g * 4 (t) «* 0, u 3 {t), u^i) indeterminate 

From equations (3.24) and (3.25), we see that there is a certain relation between u\{t) and u^t). between 
ul{t) and n 4 (t), except in the case when q[^i) = or 934(0 = 0. The four control components seem to 
work in pairs, u\(t) and u\{t) forming one pair, 113(f) and u 4 (t) forming the other. This agrees with the 
physical situation, in which tendons 1 and 2 form one pair, and tendons 3 and 4 form die other. 

Necessary conditions (a) and (c) apply directly to the tendon arm system with the appropriate 
definition of the Hamiltonian function. 



f"*^- Chapter 4. Iterative Solution of the Time-Optimal Control Problem 

4.1 Introduction 

5 In Chapter 3, we have seen that die Minimum Principle provides us with necessary conditions that 

the optimal solution must satisfy. In particular, manipulation of necessary condition (b) yields equations 
| (3.24) and (3.25) which express u*(t) in terms of x*(t) and p*[t). If the problem is non-singular, u(t) is 

well-defined and theoretically we can solve the time-optimal control problem by eliminating u{t) from 
the canonical system given by equations (3.6)-(3.8), and solving the resulting two-point boundary value 
problem to obtain x*(t) and p*{t), and hence u*[t). But two-point boundary value problems are very 
difficult to solve analytically except for some simple cases. Hence for higher order linear and nonlinear 
systems, we must in general resort to iterative methods to obtain solutions. 
A solution obtained by any iterative method is characterized by: 

1, it is only applicable to a specified initial and final position pair. To obtain solutions for other pairs, we 

have to repeat the entire iterative solution procedure, and 

2. it is expressed as a function of time. 

The first statement means that we have to precompute and store the control trajectories of every 

relevant initial-final position pair, the second means that the control is open-loop and hence cannot 

correct for any departure from the intended trajectory due to, say, external disturbances. These are 

disadvantages, but since die complexity of our system precludes any other solution approach, we have to 

I employ the iterative approach and take into account the aforementioned disadvantages in the design of 

I the overall control scheme which will be discussed in later Chapters. 

Plant[5] and Mufti[6] provide a surveys of various computational methods in optimal control problems 
and each contains a long list of supporting references. The criteria for choosing an iterative method for 
our problem are that, 
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1. it is easy to code, and 

2. it can handle singular problems. 

The second point is essential because as mentioned in Chapter 3, the possibility of the presence 
of singularity cannot be ruled out, and in fact, from some preliminary runs using the steepest descent 
method, one pair of controls docs not approach bang-bang, indicating that the pioblcm might be singular. 

There are some computational methods developed expressly for singular p« oblems (sec e.g. [7]-[10]). 
But the Conjugate Gradient method is chosen because 

1. it is basically a first order method, hence its implementation is simple, and 

2. it converges quadratically near the optimum solution, and 

3. it can handle singular problems. 

4.2 The Conjugate Gradient Method 

The first order gradient method is easy to implement but suffers from slow convergence near the 
optimal solution. In 1967, the -Conjugate Gradient Method was applied to optimal control problems [11], 
[12]. The convergence rate of this method is superior to the gradient method with very little additional 

computation per iteration. Pagurek & Woodside[13] and later Quintana & Davison[14] extended the 

f 
method to problems having bounded control constraints. 

We will first describe the Conjugate Gradient method as applied to a free end point, fixed terminal 
time, optimal control problem, and in the next section, we will show how it is adapted to solve our time- 
optimal control problem. 

Problem Statement 

Given the system 

i($^F&^ + B(x(^m, *(*o) = s& (4.1) 

Find u{t) over die interval [i > if] to minimize the cost function given by 
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J(u(t)) = K{x f (t)) + / ' L{x{t), u(t))dt (4.2) 

J to 

where tj is fixed, and u(t) is assumed to be unconstrained. 
Define die Hamiltonian 

H(x(t), p(t), u(0) = L(x(e), u(0) + P T (0[F(x(0) + 5(x(i))u(i)] (4.3) 

Then the necessary conditions as give i by the Minimum Principle are the same as equations (3.6)— (3.10) 
except for the boundary conditions (3.8) which are replaced by: 

Solution Procedure 

Define 

H u (x(t), p{t)) = ^(x(<), p(0, u(«)) = B T (x(t))p(t) (4.5) 

Let superscript i represent the iteration number, and assume that we start with an initial estimate of the 
optimal control trajectory u l (t). 

At the f th iteration, 

1. Using u { (t), integrate the state equation forward from time t$ to £/, with x(to) = xq, to obtain x l (t). 
Then, substituting x ( (t) and u ( (t ) into the costate equation, integrate it backward from tj to <o with 

p%) = -(**(«/)) 

to obtain p l (t). 
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Compute 

^) = ^(p%xit)) (46) 

2. Determine conjugate-gradient direction using: 

sty^g'M + P'-y-'it) (4.7) 



where 



r'», 

/ (o V-> T (i) 9 <- '(<)<" 

/J'-* = if t = 1 



/?*-> = ■*» if « > 1 f4 8 x 



3. Compute next control by, 



»^(()«*'ti'-oV(<). (4.9) 



where a 1 ' is chosen using a one-dimensional search to minimize J(u t+l (t)). 
4. Repeat fe whole procedurewitht = t-f 1 until /(•) does not improve significantly. 

Control Constraints 

»■ 

To take into account constraints on the magnitude of the control as given in equation (3.16), the 
above procedure is modified as follows (due to Pagurek & Woodside[13]): 

1. Assume that W) is the saturation region of uj(£); define the scale function 

w){t)^0 for teW), and j 410 j 

== 1 elsewhere 

Note: subscript j refers to individual components of the corresponding vector. 

2. When computing $ l ~\ w^ifyg^i) is used in place of tf[t). 

3. After commuting u' +1 according to equation (4.9), u i+l {t) is truncated at the upper and lower 

bounds before it is used in the computation of J{u l+i {t )). 
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43 Algorithm for the Time-Optimal Problem 

In order to apply the conjugate gradient method as presented in the last section, the time-optimal 
problem as stated in section 3.1 is modified as follows: 

1. A sequence of fixed terminal time, free end point problems are solved instead of the original free 

terminal time problem. 

2. The fixed end point constraint is handled by means of a quadratic penalty function, that is, we solve 

the following problem: 

Given the dynamical equation described by equation (3.1), find a control u(t) £ Q so as to minimize 

the following cost function: 

J = \(*{tf)-*f) T Q(<tf)-*f) (4.11) 

subject to x(to) = so, with f , fy and x f given. 
Iff/ is too small, i.e., t f < T mi -„, where T m in is the minimum time solution, the system cannot reach x f 
with the control in fi, hence J will not be close to zero. As tj increases and approaches T m i n , however, 
the optimum J value will decrease, and the smallest tf such that J is zero (within a certain tolerance) is 
the solution to the original time-optimal problem. 

Choice of tf 

We can always start with a very small tf and gradually increase the value off/, but this will take too 
long as each round (i.e. solving the modified problem with a given tf) by itself takes a long time (when 
run on a PDP 11/34 mini-computer). Hence we will make use of the special structure of the optimal 
control to provide an estimate of T mtn . 

It was found from some preliminary runs that in an optimal solution, one pair of controls, either 
uj and u% or U3 and u 4 , always approaches bang-bang with only one switching, and the form of the 
other pair will depend on the relative magnitudes of Of and 0/, which define the final position of the 
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arm (henceforth we will assume that *o = 0, i.e., we are interested in moving the arm from an upright 
position to any specified final position,. Although the two pairs of controls are coupled through the system 
equation, the coupling is not very strong, and one can clearly identify the pair u v and u 2 as affecting the 
angle 9 much more strongly than u 3 and u* and similarly, the pair u 3 , u, affects <j> much more strongly. 
Hence the time taken for the arm to move from = to = f is determined mainly by m and tia, and 
is only slightly affected by u 3 and u,, the same applies to <j> with u 3 , u 4 exchanging roles with m, u 2 . 

Hence to find the time taken for the arm to move from = <t> = to 6 = f , <t> = 0, wc will keep 
« 3 and u, to be zero (thereby ensuring <f> to stay throughout) and find a bang-bang control that will take 
9 to Of, this is a much easier problem to solve because we need only to search over the switching time, 
which is only one-dimensional and can be easily done manually. Similarly we can find the time taken to 
move from 9 = 4> = to = 0, <j> = <j> f . The larger of the two values found above will be taken as an 
estimate of T min . This value was found, in general, to be greater than T min by about one to three time 
steps (each time step is 5 msec). Hence the initial choice off/ is taken to be three time steps smaller than 
the estimated T min , and we need to solve at most three rounds of the modified problem to obtain our 
solution. 

P 
Choice of Q 

Q is chosen to be diagonal and serves to weight the different components of x individually. We chose 
the qii that corresponds to the angle that is mainly affected by the bang-bang pair of controls to be twice 
the value of the rest. This is because as the iterations proceed, it becomes more and more difficult to 
reduce that error term, as we are trying to reduce the transition time of the bang-bang control, making qu 
larger helps. 

Choice of Initial Guess of u{t) in the Conjugate Gradient Method 

The initial guess is chosen to be 
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Ui{t) ^ for i = 1, . . ., 4 and for all i € [to, i/] (4.12) 

and wc started with several iterations of steepest descent before switching over 'o the conjugate gradient 
method. 

Method of finding a 1 

As mentioned in the procedure for the conjugate gradient method, a 1 is chosen using a one- 
dimensional search technique. The method we used is to fit a parabola to three points of as, chosen so 
that die minimum of the parabola falls within die two extreme values of the q's, a 1 is chosen to be the 
value of a that minimizes the parabola. 



4,4 Approximation of the Optimal Solution 

The results obtained using the conjugate gradient method for a particular final position is given in 
figure 4-1. From this figure, we can see that the pair u 3 and u 4 approaches bang-bang with one switching, 
but not the pair u\ and U2. 

The optimal solution can be approximated by straight line segments as shown in figure 4-2, the stae 
trajectories for the optimal and the approximated control are shown in figure 4-3, and we see that the 
response due to the approximated control compares favorably with the optimal solution. Any deviations , 

from the desired state at die terminal time will be handled by another closed-loop control law which will 
be switched in after the open-loop control is terminated. 

The general form of die optimal control and its approximation will be elaborated in Chapter 6. 
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Figure 4-1. Optima] control trajectory for Bj = 0.3614, <f> f — 0.3876, 
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Figure 4-1 Straight line segments approximation of the control given in figure 4-1. 
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Figure 4-3. Slate trajectories for the optimal and approximated control of figure 4-1 and 4-2. 
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Figure 4-3, (continued) 



Chapter 5. Regulation at the Final Position 

5.1 Introduction 

Since the arm is attached to the base plate by a three degree-of- freedom "joint", positive steady-state 
tensions in the tendons are required to maintain the arm at any specified finai position. The required 
control currents can be calculated by setting 

i f = f(xf,u f ) = (5-1) 

where x f is the specified final state of the system. 

A u f that satisfies the above equation will be called a steady-state control for the set-point *,. 

If the arm is initially at the required final state x f , then u, will keep the arm at x f as long as there 
is no external disturbance. However, any slight disturbance will cause the arm to move away from this 
equilibrium position because the equilibrium achieved by applying constant open-loop controls u, is an 

unstable one. 

Moreover, the transient phase open-loop control that brings the system from initial to final state 
is based on a reduced-order model of the system, and also in order to implement it, it is necessary to 
approximate the form of control by straight line segments. The open-loop control can only be stored at a 
few points and the control law at other points is derived by interpolation. Hence at the end of the transient 
phase during which open-loop control is applied, the final state reached by the system is not x f , but rather 
somewhere in the vicinity of it. 
In view of the above, closed-loop feedback control is required to 

1. bring the system to the desired final state %j, 

2. maintain the system ati/ for any amount of time. 

5.2 Linearized Model 
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Figure 5-1. Block diagram for the closed-loop feedback control scheme. 



^-s 



Let xj denote the desired final state, and uj denote the steady-state control that satisfies equation 
(5.1). 
Define 
1. State perturbation vector Sx{t) : 

6x(t) = x(t) — x/ 



2. Control correction vector Su(t): 



Su(t) = u(t) — Uf 



f***-- 



Then the control objective can be stated as follows; 

Given 6x(t\ find 6u[r\ r > t such that future state perturbation vectors 6x{r) are as small as 
possible for all r G [£, oo), or find a controller, as depicted in figure 5-1 that will accomplish this. 

We will employ the linear-quadratic approach to designing the controller. Since we are trying to keep 
the system at a fixed set-point, this is also known as the linear regulator problem. 
First we must derive the relationship between 6x(t ) and Su(t): 
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x{t) and u[t) arc related by the system equation: 

x(t) = f(x(t), u{t)) (5-2) 

Expanding f(x{t), u{t)) about x f , u f in a Taylor scries expansion, 

f(x(t), u(t)) = f(x f , u/) + fjxf, u f )6x(t) + d £(x f , u f )6u(t) + h.o.t. (5.3) 

where h.o.t. denotes the higher order terms in the Taylor scries expansion. 

Since 

H{t) = x{t) — Xf 



and 



if = /(*/> u f) = °> 



we have, 



Sx(t)= d Axf ! Uf)6x(t) + ^(x f> Uf)Su{t)-\-h.o.t (5.4) 



dx K J ' u v ' ' du 



Define 



"-S fe,U/) ' (5.5) 

and assuming that the higher order terms are negligible, we obtain to first approximation that 

8i{t)=:A8x(t)+B6u{t) ^ (5-6) 

For the remainder of the Chapter, the ^-notation will be dropped for simplicity, and the linearized 
model will be represented as 

x{t) = Ax{t) + Bu{t) (5.7) 
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5.3 The Linear Regulator Problem 

Given the linear time-invariant system 

z(t) = Az{t) + Bu{t) (5.8) 

and its initial condition xq, find u(t) such tliat the following quadratic cost functional is minimized 

J = / (x T {t)Qx{t) + u T {t)Ru{t))dt (5.9) 

«/o 

whcreQ = Q r >0, J R==i? r >0. 

Derivation of the solution to the above problem can be found in Kwakernaak & Sivan[15J. It is 
shown that the optimal control u*(t) is given by 

u*(t)=-Gz{t) (5.10) 

where 

G = R- l B T P (5.11) 

and P is the solution of the following Algebraic Riccati Equation (ARE): 

= -PA -A T P-Q + PBR~ l B T P (5.12) 

If the original system is completely controllable, then the solution to the above ARE exists. In 
addition, since we are assuming that we are observing all the states, the system is completely observable, it 
can be shown that the feedback system is asymptotically stable (sec e.g. Kwakernaak & Sivan[15]). 

We will now consider the choice of the weighting matrices Q and R in the cost function given by 
equation (5.9): 
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In general, the selection of Q and R is not a simple matter; they are usually chosen on the basis 
of engineering experience coupled with simulation runs of the resultant system using different weighting 
values. In most practical applications, R and Q are chosen to be diagonal because in this way we can in- 
dividually penalize specific components of x{t) and u[t). We will likewise choose R and Q to be diagonal. 
Since there is no reason to penalize any one component of u{t) more than the odiers, R is chosen to be 
of the form. pi, where p is a positive scalar. Once Q is chosen, by adjusting />, we can vary the relative 
weighting between the state perturbation and control perturbation vectors. 

Specifically, the effects of p are: 

1. the smaller p is, the faster is the state perturbation vector x{t) reduced to zero, this corresponds to the 

poles of the system being pushed to the left of the s-plane. 

2. the smaller p is, the larger will be the feedback gain matrix, i.e. G in equation (5.10), this corresponds 

to large control magnitude. 
Hence there will be a tradeoff between the speed of response and the amount of control to be put into the 

system. 

When we consider the maximum allowable magnitude of control perturbation, we must bear in mind 

the control constraint which is given by 

< Ui{t) < u m ax fort = 1,..., 4 (5.13) 

where Ui[t) here is the total control input to the system. 

In our case, since we are interested in reducing the position error to zero as fast as possible, we 
choose not to penalize the velocity terms. Hence Q is of the form, 

'h 3 ' 

.0 3 3 . 
and p is chosen so that the slowest pair of poles is only slightly underdamped so that there will not be 
much overshoot. 
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Taking all these into consideration, and after some trial and errors and looking at the closed-loop 
eigenvalues and resultant runs, p is chosen to be 0.2. The values chosen are not optimal, but they repre- 
sent a reasonable choice and yield an acceptable response. The response can of course be unproved upon 
by further fine-tuning, but we are not putting any emphasis on it at this stage. 

5.4 Determination of Steady-Stale Control Input 

The steady-state control u f {t) required to hold the arm at any position, say 6 f , <f> f% ^/, can be ob- 
tained from equation (5.1), where x f = {0 f 4> f ip f 0/ 4>/ 4>/) T . Since x(t) is a 6-vector, we will 
obtain six algebraic equations from equation (5.1), but the first three do not involve u{t) and only give us 
x 4 = x$ = xq = which corresponds to 6/ = <f>j = if*/ = 0. 

Therefore from equation (5.1) and by substituting die values of x f = {0/ <t>/ ipf 0) T into 
it, we can obtain three algebraic equations involving die four scalar controls uju t = 1, . . ., 4; by solving 
these three equations, we can obtain u f . However, note that we have one degree-of- freedom in choosing 
u f subject to the three equations and the control constraint given by equation (5.13). By specifying any 
one of the u fi \ we can uniquely specify the other three. 
There are two ways of taking advantage of this one degree-of- freedom: 

1. we could, for each position, find the minimum values of control that will satisfy the three equations as 

well as the non-negativity contraint. Effectively we are setting one of the u fi 9 s to be zero and solving 
the three equations for the other three u fi \ The one to be set to zero is chosen such that all u/i's are 
non-negative. 

2. we could introduce another algebraic equation involving the u fi \ and by solving these four simul- 

taneous equations we can get unique values for the u fi \ Specifically, the equation introduced 
is 



£>< = * (514) 



»=i 
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Since all the u ;i 's are non-negative, die larger the value of k, the larger are the u fi \ In this context, 
this degree-of-freedom is thought of as providing us with the freedom of choosing the overall control 

level. 

The first method is attractive in that it provides us with a way of specifying minimum control to keep 
the arm at any desired position, since we do not want to expend unnecessary energy holding die arm at a 
fixed position. However, since one of the components will be zero, or very near zero, the non-negativity 
control constraint is easily violated when we apply the feedback control law as i iven by equation (5.10). 

On the other hand, the second method provides us with a way of specifying u, at any position such 
that Du/i at all positions within die working space is the same. This is attractive because it was found 
that if this is so, then the "main" components of the feedback gain G as given in equation (5.11) do not 
vary significantly for all the positions. This point will be elaborated further in Chapter 6. 

Hence the second approach is used. * is chosen such that for any position within die working space, 
the u/i's obtained by solving the four simultaneous equations are all non-negative. 

The value of Jfe found and used is 7, and the most critical position (with one of the u/i*s nearest to 
zero) occurs approximately at a = 45°, (3 = 10°, t/> = 45°. 






Chapter 6. Implementation and Simulation of the Overall Control Structure 



6.1 Introduction 

As stated in Chapter 1, we are interested in moving the arm from an upright position to any specified 

* final position. The overall control scheme for this movement is divided into two phases. In the first phase, 

* open-loop time-optimal control approximation is applied to bring the arm to th: vicinity of the specified 
final position. In the second phase, a closed-loop linear feedback control law will be switched in to bring 
the system to the desired final position and to maintain it there. 

In order to implement this control scheme, we must have available the open-loop control and the 
feedback gain for every final position that can be specified. Since the computation time of die former is 
too long and the memory requirement for the latter is too large for them to be calculated on-line using 
/•-\ the POP 11/45 which is used for the control of the tendon arm, they must somehow be precalculated 

and stored. Since it is impossible to store the values for every possible final position, which are infinite 
in number, we need to partition the entire state space into regions and precompute the open-loop control 
trajectory and the feedback gain of a representative point of each region and store them in tables of some 
sort. As for the other points in the region, we can either interpolate or use the same value throughout a 
region. The latter approach is employed due to: 

1. the feedback gain does not change significantly within a region, and 

2, there is no satisfactory way of interpolating the open-loop control, and since feedback control is 
I employed in the second phase, we rely on it to bring the system to the desired state, and | 
f 3. it is simple. 

The next two sections describe means of representing and storing the open-loop control trajectories 
and the feedback gains. The last section describes briefly the program written for the implementation of 
the overall control scheme. 
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6.2 Representation and Storing of Open- Loop Time-OptimalTrajectorics 

Symmetry of the Control Trajectories 

llic design and construction of the tendon arm is such that it restricts the range of movement of the 
arm. In this thesis, this range will be U ken as 

0<o< -^ 

0</?<2tt (61) 

where a, j3, rp are as defined by figure 2-4. 

We will divide this space into four quadrants with die following correspondence: 

< P < § 1st quadrant 

S < f3 < x 2nd quadrant 

•a- < /3 < 3s 3rd quadrant 

2i < fi < lit 4th quadrant * #.-..' 

For the time-optimal trajectories, Uiere is a symmetry among the four quadrants such that only those 
of the first quadrant need to be stored and those of the other three quadrants can be obtained from the 
corresponding trajectory in the first quadrant. 

Let u .^ ( = i ; . . ., 4 be the control trajectory that will bring the system from the initial position 
to a final position defined by 6 = f ,4> = <f> f , where (ty, <j> f ) is in the first quadrant (recall that the time- 
optimal control is obtained using the reduced-order model and hence i> is not relevant). 
Then, to obtain die control trajectory for 

I == _0 /5 <f> = _«^ /; exchange ui{t) and u 2 [t\ exchange u 3 {t) and u 4 {t). 
2. 6 = — } ,<t> = <i>f\ exchange u,(r.) and u 2 (t), do not cxchmgcu 3 [t) and u 4 (t) 
3 e _ g f ^ ^_ _^, /; do not exchange m {t) and u 2 {t), exchange u 3 [t) and u 4 (f ). 
Hence in all the discussion that follows, we will take the final position to be in the first quadrant. 
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Figure 6-2. Form of the bang-bang pair of controls 
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Form of time-optimal control 

As stated in section 4.3, it was found that, in general, one pair of controls is bang-bang and the other 
pair is not (both pair of controls could be bang-bang for certain values of 0/ and </>/). Which pair it is that 
is bang-bang depends on the relative magnitude of 0/ and <£/. 

In general, the pair that is not bang-bang can be well-approximated by straight line segments, and 
they can be of any form as shown in figure 6-1. The pair that is bang-bang is of the form that is shown in 
figure 6-2. Hence any pair of controls can be represented by the numbers hi, h 2 , t u t 2 , t 3 , t f as shown in 
figure 6-3. 

There are two ways of representing the open-loop control trajectory for any final position: 
1. Represent both pairs by the general form shown in figure 6-3. By choosing appropriate values for ha, 
h 2ii tu, t 2ii hu tf, i = 1> 2, we can represent any of the forms given by figure 6-1 and the bang- 
bang control of figure 6-2. (i = 1 represents u x and u 2 , % = 2 represents u 3 and u 4 ). Since in 
implementing the control scheme with a digital computer, the time axis is discrete, hence the Ufi are 
integer numbers. Using this scheme, we need a total of 4 real numbers and 7 integer numbers to 
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Figure 6-1. Various forms of the non-bang-bang pair of controls 



represent the control trajectory of each final position. 
2. Represent the non-bang-bang pair by the general form, and represent the bang-bang pair by one 

number, that of the switching time. Hence in this scheme, we need 2 real numbers, 5 integers and 1 

bit to indicate which pair is bang-bang. 
The first method is chosen because it is straightforward to code and at this stage we are only trying out 
the overall control scheme using simulation and hence the partitioning into regions is very coarse and is as 
shown in figure 6-4. We arc not too concerned yet with conserving storage. 
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Figure 6-3. General representation of any pair of controls 
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In practical implementation, we need of course to partition the state-space into a finer grid, hence 
reducing the storage requirement per point will be one of the prime concerns. We can then consider the 
following two ways of saving storage; 

1. With the sampling rate (5 msec) used, the maximum time step corresponding to t f is less than 100, 

hence we can pack two time values (e.g. t\ and t 2 ) into one word. 

2. In actual system implementation, the control will be applied to the motors via digital-to-analog con- 

verters which takes integer value as input, hence the control values can be stored as scaled integers 

instead of real numbers. 
If these two modifications are implemented, only 8 words for the first method and 5 words for the second 
method are required per point. 



6.3 Representation and Storing of Feedback Gains 
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The feedback gain G of the linear regulator design is a 4 X 6 matrix. If gy, i = 1, . . ., 4, j 
1, . . ., 6, represents the component of G, then g tj is the contribution ofxj to u iy i.e., 
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Figure 6-4. Partitioning used in the simulation run 



Ui = Ui — ]T] JijXj 



(6.2) 



where Uj is tlie steady-state control. 

Hence we can partition the matrix G into main components and cross-coupled components; 

For ui and u 2) since they directly affect 9 and 9, and only indirectly tf> and <j>, we will treat g n , &i, a* <fe4 

as main components. 

Similarly for u 3 and u 4 , since they directly affect f and <£, we will group 932, 942, 8»..f« as main 

components. 
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Figure 6-5. Cross-hatched area showing the main elements of matrix G 
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Since all four controls directly affect ip and t/>, we will treat g i3j g&, i — 1, . . ., 4, as main components. 
Hence as indicated in figure 6-5, the cross-hatched elements are the main components. 

Table 6-1 shows the feedback gains for the various positions indicated in figure 6-6 and for t/> = 0. 
From this table, we can see that the values of the main components do not vary much for different 
positions, and it is only the cross-coupled terms that change significantly, for example, compare £21, 022 of 
points 5 and 6, there is as much as an order of magnitude of difference. 

Table 6-2 shows the feedback gains for position 3 (a = */6, /? = tt/4) but with different values of 
t/>. It can be seen that all components of G do not vary significantly for different 1/?, hence we will take 
them as the same and equal to those at tp = 0. 

Table 6-3 shows the feedback gains for position 3 and its corresponding positions in the other three 
quadrants. To a first approximation, we can obtain G of the third quadrant from the first quadrant, and of 
the fourth from the second as follows: 

exchange row 1 and 2, row 3 and 4, and 

change the signs of all the elements except those of columns 3 and 6. 
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Figure 6-6. Figure showing various final positions used in Table 6-1 



tions in 



For implementation purposes, we will treat the main components of G to be die same for all posi- 
the four quadrants, using those of the upright position, and store the non-majn components for 
position 1, 3, 5 and 6 and their corresponding positions in quadrant 2, i.e., the partitioning into regions is 
the same as for the open-loop control. 



6.4 Structure of Overall Control Program and its Implementation 

The working space of the arm is defined by equation (6.1) and is partitioned into regions as shown in 
figure 6-4. The open-loop control and feedback gain of the representative point, called the center, of each 
region are stored as described in the last two sections. 

When a set-point command is issued, the program will first determine which region the final position 
is in, after which the entire open-loop control trajectory and the feedback gain G for its center are deter- 
mined, these will be used for the final position specified. At the same time, the steady-state current at the 
final position is calculated. 

The open-lpop control is then applied to the system: at each time step, generated by an interrupt 
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from the real-time clock, a control vector is output to the system. At the end of the first phase, determined 
by the final time of the open-loop control, the closed-loop linear feedback law will be used: at the occur- 
rence of each interrupt, the state of the system is read via the A to D, from which the state perturbation 
vector 8x is calculated, and the control correction vector is calculated by 

u = Uf — G6x (6.3) 

where Uf is the steady-state control vector. 
This u is then output to the system. 

Because the physical tendon arm system is not ready, the overall control scheme will be simulated on 
the PDP 11/45 computer. But the program is written as if it is a real time system except that a software 
subroutine is being substituted for the arm, and the time scale is expanded due to the length of time 
required for the subroutine. The block diagram for the program is given in figure 6-7, 

Figure 6-8 shows the state trajectories for three different final positions. 
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Figure 6-7. Block diagram for the overall control program 
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Figure 6-8. Trajectories for three different final positions 
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Tabte 6-1 Feedback gains far the various positions shown b 
Figure 6-6 



-4.0294D+00 -2.11030-01 1.50440+00-6,06780-01 -2.23330-02 8.30860-02 
4.02340+00 2,11030-01, 1.50440+00 6.0678D-01 2.23330-02 8-30860-02 

-2.89600-01 -4.83190+00-1.53630+00 -1.80810-02 -7.53780-01 -8-48500-02 
2.89600-01 4.63190+00-1.53630+00 1.80810-02 7.53780-01 -8-48500-02 



-3.49400+00 3.6891D-C1 1 .04160+00 -5 .3920.0-01 4.26700-02 6-9065D-02 

3.58e9D + C0 7.44370-0.1 1.04920+00 5.95550-01 8.72050-02 6-9174D-02 

1.70860-01 -4.3907D+0C -1.03960+00 2.6577D-02 -6.8781D-01 -6-9136D-02 

5.5215D-01 4.36730+00 -1 .0971D+00 4,17200-02 7 .34140-01 -7 .20710-02 



3 <* » 30* . /J a 45* 

-3.63660 + 00 1.0323D+C0 1 .0381 0+00 -5 .28840-01 1 . 10980-01 6 .94760-02 

3. 70280+00 1.17660+00 1.04800+00 6 .3000D-01 1.41530-01 6, 9113D-02 

9.27020-01 -4.44830+00 -1 .01310+00 9.91820-02 -6.52230-01 -6.80770-02 

5.69050-01 4.40910+00 -1.1 180D+00 3.3458D-02 7 .4456D-01 -7 .32970-02 



4 <*--45 # . />*4S* 

-4.2914D+00 1.6954D+00 1 .0417D+00 -5 .46040-01 1.70140-01 7.0824D-02 

3.88810+00 1.63450+00 1.04020+00 6.7243D-01 2.01660-01 6.8619D-02 

2.0307D+00 -4.58050+00 -9.93080-01 1.9637D-01 -6.1743D-01 -6.76770-02 

3.8914D-01 4.60250+00 -1 .1267D+00 -5.84560-03 7.61070-01 -7.3971D-02 



^#"*>v 
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5 oc*30 f , £* 0* 

-3. 34160+00 1.3S73D+C0 1 .06030+00 -5.5295D-01 1.67310-01 7-08430-02 

3.6233O+C0 1.85340+00 1. 09630 + 00 5. 72160-01 2.12130-01 7.3349D-02 

-2.55940-C1 -4.91480+00 -9. 06540-01 -7. 62110-03 -7. 14830-01 -6.21950-02 

3. 95950-01 4.74320+00-1.13620+00 3.66990-02 8.09380-01 -7.3063D-02 



6 <** 30* , p> * °lO* 

-3.76330+00-1.30650-02 9.7825D-01 -5. 12580-01 -9.66560-04 6.55430-02 

4.02620+00 3. 54340-01 1.00330+00 6.7718D-01 3.68480-02 6.5561D-02 

8.2385D-01 -3.88340+00 -1.15230+00 8.1149D-02 -6.09830-01 -7. 56130-02 

1.39340+00 4.16610+00 -1 .0909D+00 1 .11880-01 6.6908D-01 -7.34580-02 



7 oc --45* , (b * 22-5° 

-3.90040+00 2.67390+00 1 . 1 1 030+00 -5 . 541 6D-01 2.86320-01 7.55400-02 

3.45750+00 2.5295D+00 1.09460+00 6. 02140-01 2.94110-01 7.35030-02 

1 .04340+00 -5.05840+00 -8.36550-01 1.0865D-01 -6.72510-01 -5.81130-02 

1.21790-01 5.27180+00 -1.12410+00 -1.29450-02 8.7344D-01 -7.22370-02 



-4.16080+00 7.1318D-01 9.25940-01 -5.08270-01 6.62690-02 6.29460-02 

4.52810+00 9.10090-01 9.99790-01 7.45590-01 1.12040-01 6.47840-02 

2.36930+00 -3. 8769D+C0 -1 .15570+00 2.2660D-01 -5.3739D-01 -7.72280-02 

1.22490+00 4.01570+00-1.12830+00 7.1972D-02 5.44590-01 -7.59140-02 



^***\ 
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Table 6-£ Feedback, gain for positions with *. * 30° , p = &>* 
ond different values of t|) 



*0 



-3.71230+00 1.00240+00 1.05720+00-5.30190-01 1.05?SO-01 7.0897D-C2 

•3.7314.0+00 1.15C60+C0 1.06100+00 6.33140-01 1.37280-01 6.99600-02 

9.2553P-01 -4.35680+00 -9.833VD-01 1 .00100-01 -6.41030-01 -6-61900-02 

5.71940-01 4. 28930+00 -1.10160+00 3.42350-02 7.27660-01 -7.23090-02 



£ 4> • °° 

.3.68660+00 1. 03230+00 1.03810+00-5.26840-01 1.10980-01 6. 94780-02 
3.70280+00 1.1766D+00 1.04800+00 6.30000-01 1.41530"01 6-91130-02 
9.27020-01 -4.44830+00 -1.0131D+00 9-91820-02 -6.52230-01 -6-80770-02 
5.69050-01 4.40910+00 -1.11800+00 3. 34580-02 7.44560-01-7.32970-02 



3 t|) • + 30* 

-3 65570+00 1.06440+00 1 .01930+00 -5 .26940-01 L16920-01 6-81260-02 
3.67060+00 1. 20220+00 1.03500+00 6.26420-01 1.45770-01 6-82660-02 
9.27,50-01 -4.54150+00 -1.04110+00 9.82310-02 -6.63710-01 -6-98760-02 
5.63790-01 4.53720+00-1.13220+00 3.25310-02 7.62490-01-7-41580-02 
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Table 6-3 Feedback gains for oc= 30°, /2>=4&» 
and ifs corresponding positions in 
the other 3 quadrants 



■ 




X 






2, 



-3.68660+00 1.0323D+00 1.03810+00-5.28840-01 1.10980-01 6.9478D-02 

3.70280+00 1.17660+00 1.04800+00 6.30000-01 1.41530-01 6.9113D-02 

$.27020-01 -4.44830+00 -1.01310+00 9.91820-02 -6.52230-01 -6. 80770-02 

5.69050-01 4.40910+00-1.11800+00 3.3458D-02 7.44560-01 -7.32970-02 



_ /~*\ 



I 



-3.O90SD+C0 -1.1524D+00 1. 05070+00 -5.44070-01 -1.25120-01 7.04840-02 

3.61380+00 -4. 72G9D-C1 1. 00910+00 6.2405D-01 -7.03780-02 6..6632D-Q2 

-1 .25740-01 -4.183^0+00 -1. 16820+00 -2.19930-02 -7.0808D-01 -7.54080-02 

1.46150+00 4. 658e0+00 -9.91540-01 1.18710-01 7.08420-C1 -6.79170-02 



X 



-3. 70280+00 -1.1766D+G0 1. 04800+00 -6.30000-01 -1 .41530-01 6.91i3D-02 

3.68660+00 -1 .0323O + C0 1.03810+00 5.2S84D-01 -1.10980-01 6.94780-02 

-5.69C50-C1 -4.4091D + C0 -1. 11600+00 -3. 34590-02 -7.44550-01 -7.32970-02 

-9.2701D-01 4.44S30+00 -1.01310+00 -9.9182D-02 6.52230-01 -6-80770-02 



/-N 



TL 



-3.6238D+00 4.75280-01 1 .00840+00 -6 . 23930-01 7.11270-02 6.6653D-02 

3.8721D+00 1.15040+00 1.05120+00 5.4358D-01 1.24900-01 7.04660-02 

-1 .4444D+00 -4.6586D+00 -9.91580-01 -1.18300-01 -7.08420-01 -6.79140-02 

1 .39260-01 4.18380 + 00-1.16830+00 2.20270-02 7.08140-01 -7.54070-02 



Chapter 7. Conclusions* 



7.1 Summary 

In this thesis, a mathematical model describing the dynamics of the tendon arm system has been 
developed. From this, we obtained a reduced-order model of die system and applied the Minimum 
Principle and the conjugate gradient mediod to obtain die time-optimal solution. It was found Uiat the 
optimal solution is not bang-bang but that it contains singular arcs. But it was also found that these 
singular arcs can be approximated very well by straight line segments, this approximated control is then 
utilized to form part of the overall control scheme. 

The open-loop tendon arm system was found to be unstable, and hence to maintain the system 
at any state, closed-loop feedback control is required. The feedback law was designed using the linear 
regulator design procedure, linearizing the nonlinear dynamics about die final state and the nominal 
control required to keep the system there. 

The two control schemes are combined with the first phase being open-loop time-optimal control, 
bringing the system from its initial state to a waypoint in the vicinity of the final state, the second phase 
then employs the closed-loop control law to bring the system to the final state and to maintain it there. 

It was intended initially to implement the overall control scheme on the actual physical system, but 
due to unforeseen circumstances, this was not possible, instead, digital simulations of the system with the 
control scheme implemented were done: 

7.2 Areas for further work 

There are a few directions that we can go from here: 

1. Implement the control scheme on the actual physical system — this is the most natural extension to 
the present work. However, before this can be done, there arc a few problems to be taken care of: 
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a. The control vector of our problem is formulated in terms of input currents to the motors. The 

drivers for the tendon arm motors, however, are voltage amplifiers, hence we have to reformu- 
late and solve our problem in terms of voltage inputs. This can be easily done however, and the 
way to do it is shown in Appendix F. 

b. The linear regulator design assumes full state feedback. For the tendon arm , wc have only angle 
- measurements but not velocity measurements, we need to find some means of constructing 

the full state (the simplest way, of course, is to use backward differencing of the angles to 

approximate the velocity terms), 
c In the simulation of the control scheme, a very coarse grid is utilized to partition the state space. 

In actual implementation, a finer grid has to be used, and the problems of how many grid 

points to use and where to place them have to be considered. 
f~\ 2. Investigate other means of simplifying the model — the biggest disadvantage of the present control 

scheme is that the third degrec-of-freedom , namely, if>, is not being controlled during die first phase 
of movement, this is due to the approach employed in simplifying die system equation. It was found 
that the coupling between and <f> is not very strong, thus it may be possible to simplify the system 
equations while retaining the full order dynamics. 

3. The motivation of using time-optimal control initially is because of its bang-bang solution nature (i.e. 

in the absence of singularity). It would be interesting to formulate the time-optimal control problem 
as one having a discrete control set constraint, i.e., 
I 

I Ui{t) e {o, u max } 

and find out what the form of the optimal solution is. It should also be interesting to formulate the 
time-optimal problem based on the full order model and solve it, if possible, to see whether it is 
bang- bang. 

4. In our control scheme, wc have utilized the measurements of die angles 0, <f>, and tp but not the four 
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motor shaft angles. Investigate other control strategies that will take advantage of the availability of 
all seven angles. 



' 4"**%. 
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Appendix A. Deriving the equations of motion of the system when either pair of 
tendons is completely unwrapped from the arm 

Due to the way the four tendons arc wrapped around the arm, at any one '.imc'.it is possible for only 
one pair to be completely unwrapped. Hence there arc three different sets ol equations describing the 
motion of the system depending on the values of u> + X and u/ + V (refer to figures 2-7(a) and 2-8(a) for 
the definitions of w, X, u/, X', where R; is now the point at which a tangent from P x touches the arm, all 
projected onto the x 1 — y' plane). 
The three cases correspond to: 

1. u; + X < 3tt/4 and u/ + V < 3tt/4, both pair of tendons are properly wrapped on the arm, this is 
the normal mode of operation, 

2 w + X > 3tt/4 and w' + V < 3tt/4, die first pair, corresponding to tendons 1 and 2, is completely 
unwrapped, whereas the second pair remains wrapped. 

.3. tu + X < 3ir/4 and u/ + V > 3tt/4, the first pair remains wrapped, whereas the second pair is 
completely unwrapped. 
The equations of motion corresponding to case 1. have been developed in Chapter 2; those of the last two 
cases will be developed in this Appendix. 

A.l Tendons 1 and 2 arc completely unwrapped 

When w + X > 3tt/4, where u; and X are still being defined by equations (2.7) and (2.8), tendons 1 
and 2 arc completely unwrapped, the situation js shown in figure A-l. 

The directions of Fj and F 2 (the tensions in tendons 1 & 2) arc now given by QiPi and Q 2 P 2 
respectively, and equations (2.12H2T3), (2.17H2.18) arc modified to 
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Figure A-l. Schematic diagram showing the arm and tendons 1 & 2(projected onto the x> — y' 
plane) when u> + X > 3ir/4. 



y*—\ 



Li = ii = Q1P1 



(acos0sini/> p) 2 + (a cos cos t/H p) 2 + (6 + asin0) 2 

2ab sin + a 2 -f & 2 + P 2 + V^pa cos 0(cos ^ — sin ip) 



L2 = l 2 = Q2P2 = 



£ 



]£ 

(— acosflsin^H p) 2 -\- {—a cos 6 cos ip p) 2 -\-(asin0 — b) 2 

^ sft J 

— 2a6 sin + a 2 + 6 2 + p 2 + \/2pa cos 0(cos V> — sin V>) (4.2) 



Equation (2.35) now becomes: 



Resultant torque acting on the arm about point O 



= OQx XF l +OQ 2 xF 2 + OR 3 X F 3 + OP 4 XF A + OGXmg 

OQ2 X Q2P2 + T^Vr°^3 X R 3 >3 



Fi - Fo ^~„ , F3 

1 r oQixQ,p,+ '*—""»" 3 



IQ1P1I 



I&P2I 



IF-3P3I 



F4 



+ Tjffl 0R 4 X H4P-1 + mg OG X GD 
= iT l +jT 2 -\-kT 3 



04.3) 



^** S : 



where 
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T,= 






pa sin 9 — ab cos cos tp 

V2 



+ § 



pa si n + ab cos cos V> 



4- — [ps sin <t> cos 5 sin(u/ + X') — 2 3 s(cos <f> sin xp — sin sin <£ cos V)] 

+ — [ps sin <£ cos sin(w' + X') + z 4 s(cos <j> sin ip — sin sin ^ cos V)] 
-j- mgd(sin sin xp 4- cos sin cos ^) 



r,= 



F, 



— pa sin + ab cos sin </> 

:V2 



+ 



*k 

^2 



— pa sin — ab cos sin ^ 
.\/2 



_|_ ^1 [_ ps sin </> cos 5 cos(w' + X') — «3s(cos<A cos ^ + sin ^ sin </> sin V)] 
L3 

4. LW \--p S sin <£ cos cos(w' + V) + z A s{cos <j> cos V + sin sin <£ sin t/>)] 

L4 
-f mgd(sin <£ cos tp — cos <£ sin sin VO 

T 3 = ILL _|_ _1 J pacos0{cosip4-smtp) 

_4_ ( ^2 + *A)p8 [sin <£ sin 9 cos(X' + //) - cos <? sin(X' + //)] 

V.^3 ^4/ 



(/U) 



(4.5) 



(A6) 



In equations (A.4HA.6), Lj and L 2 are as denned in equations (A.l) -<A.2), the others are defined as in 
equations (2.19H2-32). 



A.2 Tendons 2 and 4 are completely unwrapped 



Following the same procedure as in section A.l, when J + V > 3x/4, the directions of F 3 andF 4 
will be given by Q3F3 and Q4F4 respectively, and 
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^3 = ^3= Q3^3 



[( — s cos <fr cos ip — s sin <f> sin sin t/> p) 2 

+ (scos^sint^ — s sin <f> sin cost/? -| p) 2 

a/2 
+ (— 5sin0cos0 — i) 2 ]* 



= [s 2 -f t 2 + p 2 + \/2ps cos <f>(cos ip + sin ip) 

+ v^ps sin <£ sin 0(sini/> — cost/;) + 2«£sin^cosflp 



(,4.7) 



L 4 = l 4 = Q4P4 



[(s cos <p cost/? + ssin<£sin0sint/> -| p) 2 

\/2 



-f ( — s cos </> sin ip + s sin </> sin cost/? p) 2 

\/2 

+ (5 sin ^ cos 5 — t) 2 ]i 

= [s 2 -f- < 2 + p 2 + V^ps cos<£(cos ^ + sin ip) 

+ \/2ps sin </> sin #(sin t/? — cos t/>) — 2sf sin cos 0] * 



(.4.8) 



r^ 



r» p 

Ti = -=J- [—pa sin cos(a; + X) — ^a cos cos t/>] + 7- (—pa sin cos(u> -f- X) + zqa cos cos ip] 

p % 

-f- -4[ ps sin<£cos0 — £s(cos0sin^ — sin <p sin cos -0)] 

L 3 v/2 

r» 1 
+ -=4[ ps sin <pcos0 + £s(cos</>sint/? — sin <£ sin cos ^)] 

L 4 v/2 
+ mjd(sin sin ip + cos $ sin cos 0) 04. 9) 

171 p 

T2 — 7^ [pa sin sin(c<; -f X) + z\a cos sin ip] + — [pa sin sin(u; + X) — z^a cos sin $ 

-f- t^[ pssin<£cos0 — is(cos <p cos tp + sin <£ sin sin t/?)] 

L3 V2 

r» 1 

4~ t^[ pssin<£cos0 + fs(cos<£cost/> -f- sin <p sin sin ip)] 

-f mgd(sin <0 cos t/? — cos <£ sin sin ^) 

,F\ Fok 
T 3 = (j± -f -i- )pa cos I? sin X 

+ (7^ + 7^) ps[cos<£(sin^?—- cos^) — - sin<£sm0(cost/> -f sin0)] 

L 3 L 4 ^ 



(4.10) 



(4.11) 
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Note: In equations (A.9MA.11), U and U are as defined in equations (A.7) and (A.8), the others are as 
defined in equations (2.7>-<2.18). 

A3 Equations of Motion 

The equations of motion for the two cases of unwrapped tendons can be derived following the proce- 
dure in subsection 2.2.4, and instead of using equations (2.36)-(2.38) for the expressions for T u T 2 , and 
T 3 , equations (A.4)-(A.6) or equations (A.9HAT1) are used depending on which pair of tendons are 
unwrapped. The full detail of the equations corresponding to equation (2.48) is given in Appendix B. 



r^ 



Appendix B. Equations of motion for the full order model 



By substituting expressions for 7i, T 2 , T 3 and equations (2.40)-(2.45) into equations (2.39), the three 
equations become, 



/cos^--^(c„-+c ia ^^c l3 ^+ C H^) 






J COS 9 Sin V) 5-(CllZI + C 12^7 + C 135T + C 145l) 



*<fy 



J (9^> 



<fy. 



J m <*, <% 2 <* 3 . <9^ 









+ 4> 



.•s„ 



dh 



+ 



B n 



r 



Oil #2 <9b #4 

Cu ^ +C12 ^ +C13 ^ +C14 a> 

dl\ &2 , <% i <^4 

Cll ^ + Cl2 ^ +Cl3 a^ +C,4 o^ 



+ ^ 



{-J + J 3 ) S m0cos6cosrP+ -^{cii^ + c l2 ^ + c *3^2 + c i^) 






Cll^TTo + C 125T9 + c 13 



(92/4 



+ 2ty 

+ 2# 



^2 ' ""^2 ' " 1J ^ 2+Cl4 ^ 2 

#1, 



(J - _j 3 ) S in^in^ + ^-(d,— +ci 2 — +c,3^ +ci4— ) 



~ cost/>cos# + ~y( c n 



Jrrif 

r 2 



*'l 4-, ^ 4-, 



<9 2 / : 

c 

6% 



d<pdip 



d<bd$ d<fidip 



% 

+ Cl4 aW ) 






(5.1) 
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J?n, <9h , dl '2 , °»3 | „ ui U 

-J sin t/> - -5-(ft, ^ + C22^ + ^23^ + c 24 ^) 



<% 



<*4, 






J COS0CO8 V - -T^lAl + ^AA + C237TT + C 24 -) 



'<9<£ 



d<j> 



J d<j> 



d<t> J 



•W «1 ...„«2_l.*.,*+ C24 *i) 



-5( C21 ^ +C22 ^ +C23 ^ 



<90 J 



= — Nl^l + ^22^2 + C23/3 + C24/4] + C 2 5 + ^-J 1 



dU 



& 4 



C21 



(9/i , C#2 1 ~-o . „ -«* 



+ tf> 



Br, 



;B rl 



■-J- -0 



+ 2 # 



C21 ^ + C22 ^ + C23 ^ + C24 #J 

C2 W +C22 ^ +C23 ^ + ^ 
C21 ^ + C22 ^ +C2 W + 24 ^2 



£2 



+ * 



&i { . a 2 / 2 . <9% . ^ 



(J - J 3 ) Sin ^ COS^ Sin t/> + -o-(c21^ + C22^72 + C23^T2 + C,™) 



<9^ 2 



3 <9<£ 2 



*c9<£ 2 
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+^ 2 S 



A , <9 2 *2 , ^3 ,, ^4 

'"~^ +C24 c?V 2 



C21 ^+ C2 W +C23 ^ +C24 



+ 20<£ 
+ 2# 



it 1 r\ • fl (I *^"^ ^1 I 

(J- -/ 3 )Mn*COBtf + ^-(cai^^ + 



£5* + C22 a^ + C23 a^ + C24 <^ 

<W + C22 5W + C23 W + C24 <W 



J 3 cos0 sinV- + ^f(c 21 ^7 + 022^^ + c 2 3^rr + c 24 



ij 3 COsV+^(c 2 l|^+C 22 ^^ 



+ C 2 3 



d% . <9% , . d\ , , ^4^ 



<9t/*90 



+ C 2 4 



<9V«90 J 



(B.2) 
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^•"S 



^ 
r^ 



+ 
+ ^ 



r ._/j «^n/ <^J | „ <^2 , „ $3 , $4x 

-J,Sm6- ^(C 31 - +C 32 - + C 33 - +C34^)j 



/„,, <9/] <9f 2 . <% , „ <*4 

^3 2"l c 31ST + C 32ST ~r C 33 5T + c 3'i 



'dip 



'dip 



dip 



= - [C3l/l + C32/2 + c 33 7 3 + c 34 /.i] + A 
r r l 



^31 7^ + c 32^ + C 33^T +C34 — 



l <90 



C <90 



'60 



l dQ 



+ ^72- 



<9!i <9K 2 . $3 ■ dl 4 

C3l d$ +C32 d$ +C33 d4> +C34 W 

(9t/> &4> d$ &tp 



+ <A 



;o*A 






„ d\ &h &U 

C3l dfi + C32 d¥ +C33 ^ + C34 ^ 



C 3 1 



l otf 2 



-m 2 S 



'<9</> 2 



5% 
2 <9<£ 2 



&h 



d% 



dtp 2 + C32 d<j> 2 + C33 d<f> 2 + C34 a^ 2 



'dip 



2 "*" C33 A/,2 "T c 34 „ , , 



+ .2^ 



C 31Z^2 + C32 W 
1 , , . / m , ^1 , <^2 



-7 3 cos0 + ^fc 3 i 

2 3 ^ r* K3x d9d<p 



dtp 
+ C32 



a*9tf> 



^ 2 



+ C 3 3 



&h 



+ W% 



C31 a 'Ai, + C 32^7ST "T c 33 Q2gl . + C34 



^4 



4-, ^M 

+ C3 W 



+ 2#^ 



C31 






<ty90 



J <W 



, <9 2 i 2 , #f 3 , 

+ C 325T5^ + C 335T^; + C34 



'dipdO 



°dipffl 



d<pdip 

dipae 



(B.3) 



In the above three equations, the values of cy, Lj, lj, i = 1, 2, 3, j = 1, . . ., 4, will depend on the 
values of w + X and J + V as defined by equations (2.7H2.8) and (2.19H2.22). 



Foro; + X<37r/4, 



c u = [— pasinffcos(a; + X) — z\a cos ^ costal /L\ 
c n == ["^"P s ' n # cos(a; + ^) 4~ - 2r 2 a cos cos ^]/Z<2 
Qi = [pa sin s\n((jj ~{-\) -\- zia cos sin ip]/L\ 
c 22 = [pasin^sin(u; + "M — ^2^c° s ^sin^]/L2 
C31 = pacos0sm\/L\ 
C32 = pa cos sinX/L2 
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z u L u h,z 2 , L 2 , h are as given by equations (2.11) -(2.13) and (2.16H2.18). 
Foru> + X>3ir/4, 



Cn = [ pas\n0 — ab cos cos ip]/Li 

V2 
c l2 — [ pa sin 6 + ab cos 6 cos </>]/ Lq 

c 21 = [ pasin0 + a6cos0sinV>]/Li 

C22 = [ pa sin — a6cos0sint/>]/L 2 

c 31 = pacos0(cost/>-f sinip)/Li 

c 32 = - — pa cos 0(cos V> + B\nip)/L2 
V2 



Li, l u L 2 , h are as given by equations (A.l) and (A.2). 
Foru/ + X'<37r/4, 



c 13 = [ps sin <f> cos sin(u/ + X') - *3«(«>s <£ sin </> - sin sin <f> cos V)]/L 3 
Cl4 = [ps sin * cos sinK + V) + z 4 s{cos <j> sin V> - sin sin <£ cos V)]/L 4 
C23 = [_ pss intf>cos0cos(u/ + X') - ^(cos <f> cos t/> + sin sin <l> sin tp))/L 3 
C24 = [_ ps sin cos cos(u/ + X') + «4s(cos cos xp -f sin sin <j> sin V)]/L 4 
c 33 = ps[sin<£sin0cos(X'-tV) — cos 0sin(X' + //')] /^3 
C3 4 = ps[sin</.sin0cos(X' + M') — cos0sin(X' + //)]/^4 



23, L 3 , *3, 24, -U '4 a rc as defined in equations (2.25)-(2.27) and (2.30)-(2.32). 
Forw' + X'>37r/4, 



/""S 
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c i3 = [ ps sin <j> cos — st{cos(j>B\x\xj) — - sin#sin<?icos tp)]/L3 

n/2 

c 14 = [ — /?ssin<£cos0-f s£(cos<£sint/> — sin#sin0cosi/>)]/L4 

c 23 = [ p$s\n<f>cos0 — st(cos <f> cos tp -f- sin#sin<£sin t/>)]/L3 

C24 = [ ps s\n<f>cos0 + si(cos<^cost^ + sin^sin^sin (/?)]/L4 

C33 = ps[cos<£(sin^/> — costp) — sin<£sin#(cosi/> -+- sint/>)]/L3 

n/2 

C34 = ps[cos <f>(s\n ip — cos^) — sin<£sin0(cos^ + sin 0)]/L4 

L3, / 3 , L4, J 4 are as defined in equations (A.7) and (A.8). 



For all cases, 



c 15 = mgd(sin <f> sin ip -f- cos s * n # cos i>) 
C25 = mpd(sin <f> cos ip — cos <f> sin sin ip) 



Equations (B.1HB-3) are of the form, 



hud + h i2 4> + hitfj> = &(0, 0, ip, t 4, ip) + J] $,-£ i 



= 1,2,3 



(B.4) 



where the/iy's, and &/s are functions of t <p, ip. 
Written in component form, 



Define 
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(J3.5) 
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Then from equation (B.5), 
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(B.8). 



Define 



$ = \9 <f> V # <i> <i>\ T 
tx = [h h h h\ 



a 6-vector 





"X4" 






a* 




Fo{x{t)) = 


/4 
/5 
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.°._" 




...9.... 


£b(*(0) = 




"fe 4 




-- 
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r rhen equatipn (B.6) can be written as 



a 6 X 4 matrix 



i = F {x)+Bo{x)u 



which is equatipn (2.48). 



s\ 



Appendices C-E have been excluded from the Memo version of this thesis. 



<3<X 



Appendix F. Using voltage instead of current inputs 



The electrical equation of motor * is given by, 



V.^L^+RIi + KETii ( F1 ) 

at 

where U R, K E are the motor's inductance, resistance and EMF constant respectively, and «fc is the 



angular speed of the motor. 

For the pancake type of motor that we are using, 

L a ^0 

and since in S.I. units, the EMF constant and the torque constant are equal, we will use the symbol K for 
both of them. 

Hence equation (F.l) can be written as 

Vi = Eli + Kji 

h R y^ R lt 

From equation (2.42), the dynamic equation of motor i is given by, 

J m ii+Bmii+Fir = KU VV 

Substituting equation (F.2) into (F.3), we obtain, 

«+(^+£h+*' = s v {fa) 

which is of the same structure as equation (F.3) except that (B m + K*ffl is substituted for B m mdK/R 

is substituted for K. 

Hence all the equations and programs that have been developed for current inputs can be applied to 
the case of voltage inputs by changing the values of the damping constant B m and torque constant K of 

the motor. 
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Appendix G. Values of the parameters used in the simulation runs 



G.l Arm Parameters 

a 0.4064 m refer to figure 2-6 '; 

b 0.4064 m refer to figure 2-6 

d 0.117 m refer to figrre 2-6 

s 0.2032 m refer to figure 2-6 

t 0.2032 m refer to figure 2-6 

P 0.02223 m radius of the cylindrical rod 

m 1.581% mass of arm 

J 0.0906 kg m 2 momemt of inertia of am about X — X and Y — Y axes 

^3 0.000407 kg m 2 moment of inertia of arm about Z — Z axis 

G.2 Motor Parameters (PMI motor type U12M4) 

r 0.016 m radius of motor shaft 

K 0.11 Nm/ A torque constant 

Jm 0.00016 kg m 2 moment of inertia of motor shaft 

B m 0.000135 N m/rad s~ l damping constant 

The rated current of the motor is 4.4 A. 
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